
Take a scientific approach to science
Madigan D, Ryan PB, Schuemie MJ et al, American Journal of Epidemiology, 2013
“Evaluating the Impact of Database Heterogeneity on Observational Study Results”
Madigan D, Ryan PB, Schuemie MJ, Therapeutic Advances in Drug Safety, 2013: “Does design matter?
Systematic evaluation of the impact of analytical choices on effect estimates in observational studies”
Ryan PB, Stang PE, Overhage JM et al, Drug Safety, 2013:
“A Comparison of the Empirical Performance of Methods for a Risk Identification System”
Schuemie MJ, Ryan PB, DuMouchel W, et al, Statistics in Medicine, 2013:
“Interpreting observational studies: why empirical calibration is needed to correct p-values”
1. Database heterogeneity:
Holding analysis constant, different data may yield different estimates
2. Parameter sensitivity:
Holding data constant, different analytic design choices may yield different
estimates
3. Empirical performance:
Most observational methods do not have nominal statistical operating
characteristics
4. Empirical calibration can help restore interpretation of study findings